Convergence Rate Analysis of a Stochastic Trust-Region Method via Supermartingales
نویسندگان
چکیده
منابع مشابه
Convergence analysis of Riemannian trust-region methods
This document is an expanded version of [ABG05], with a detailed convergence analysis. A general scheme for trust-region methods on Riemannian manifolds is proposed and analyzed. Among the various approaches available to (approximately) solve the trust-region subproblems, particular attention is paid to the truncated conjugate-gradient technique. The method is illustrated on problems from numer...
متن کاملConvergence Rate of The Trust Region Method for Nonlinear Equations Under Local Error Bound Condition
In this paper, we present a new trust region method for nonlinear equations with the trust region converging to zero. The new method preserves the global convergence of the traditional trust region methods in which the trust region radius will be larger than a positive constant. We study the convergence rate of the new method under the local error bound condition which is weaker than the nonsin...
متن کاملRate of Convergence of a Stochastic Particle Method
In a recent paper, E. G. Puckett proposed a stochastic particle method for the nonlinear diffusion-reaction PDE in [0, T]xR (the so-called "KPP" (Kolmogorov-Petrovskii-Piskunov) equation): %=Au = Au + f(u), u(0, •) = «(,(•), where 1 Mr, is the cumulative function, supposed to be smooth enough, of a probability distribution, and / is a function describing the reaction. His justification of the m...
متن کاملStochastic Optimization Using a Trust-Region Method and Random Models
In this paper, we propose and analyze a trust-region model-based algorithm for solving unconstrained stochastic optimization problems. Our framework utilizes random models of an objective function f(x), obtained from stochastic observations of the function or its gradient. Our method also utilizes estimates of function values to gauge progress that is being made. The convergence analysis relies...
متن کاملMultivariate GARCH estimation via a Bregman-proximal trust-region method
The estimation of multivariate GARCH time series models is a difficult task mainly due to the significant overparameterization exhibited by the problem and usually referred to as the “curse of dimensionality”. For example, in the case of the VEC family, the number of parameters involved in the model grows as a polynomial of order four on the dimensionality of the problem. Moreover, these parame...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: INFORMS Journal on Optimization
سال: 2019
ISSN: 2575-1484,2575-1492
DOI: 10.1287/ijoo.2019.0016